NETWORK -LINKED INTERACTIVE THREE-DIMENSIONAL COMPOSITION AND 
DISPLAY OF SALEABLE OBJECTS IN SITU IN VIEWER- SELECTED SCENES FOR 
PURPOSES OF PROMOTION AND PROCUREMENT 



5 BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention generally concerns the computerized 
composition and display of perspective images of real or virtual 
three-dimensional objects, most typically objects for sale, located 
10 in, surrounding or in front of, real or virtual three-dimensional 
scenes where both objects and scenes are not fanciful, but are or 
could be existing within the real world, for the purpose of 
□ advertising or selling the depicted objects. The composition and 

display may be, by way of example, (i) the selection and placement 
of furnishings within interior rooms, or (ii) the selection and 
display of eyeglasses upon the head of a prospective purchaser, for 
Q purposes of advertising or selling either room furnishings, or 

M eyeglasses, as the case may be, by depicting these objects in three- 

J]:^ dimensional scenes unique to the viewer, such as in the viewer's own 

lifO home or on the viewer's own head. 

1^^; The present invention particularly concerns the communicat ions- 

network-linked software-program-driven computerized selection, 
Q composition and imaging of furniture and furnishings, including of 

virtual objects that are not yet fabricated, in perspective view 
25 within real or virtual rooms responsively to interaction with 
professional interior designers and decorators, the man-machine 
interaction being so that designs of, inter alia, furnished rooms 
may be both interactively developed across a digital communications 
network and, ultimately, displayed to a prospective consumer- 
3 0 purchaser of the room furnishings and/or the room. 

The present invention also particularly concerns 
communications-network- linked software-program-driven computerized 
selection, composition and display -- in response to interaction 
with professional opticians and optometrists -- of eyeglasses. 



including virtual eyeglasses not yet fabricated, upon the head of a 
prospective consumer purchaser of the eyeglasses; the display being 
to the end of advertising eyeglasses to, promoting the efficient 
selection of eyeglasses by, and/or selling eyeglasses to, 
prospective eyeglass purchasers. 

2 . Background 

2 . 1 General Background 

The present invention will be seen to have both (i) business 
and (ii) technical aspects. Technically, the present invention will 
be seen to broadly concern a software-based system for both (i) 
interactively producing, and (ii) rendering, across a digital 
communications network, photo-realistic composite images of 
interactively customized products in such surroundings as are 
customary to and specified by the viewer of the image, different 
viewers desiring and appreciating different surroundings. Business- 
wise, this rendering, typically conducted as a network service at no 
cost to enrolled business professionals, is for the purpose of 
promoting and selling such products. These customary surroundings 
are referred to herein as "background scenes". The selected and 
placed product images will be seen to include, by way of example, 
(i) images of interior furnishings, rendered within background 
scenes of interior spaces, and (ii) images of eyeglass frames, 
rendered within a background scene consisting of the head of a 
prospective purchaser. 

2 . 2 Previous Patents Directed to Interior or Exterior Design 
United States Patent 4,318,121 to Taite, et . al . , for INTERIOR 

DECOR COMPOSITION AND DISPLAY SYSTEMS concerns display systems are 
of particular utility in assisting interior decorators and 
homemakers in selecting appropriate color and fabric combinations. 
In particular, the subject display systems provide a luminous image 
of an interior decor including components, such as furniture, drapes 
and carpets. The system picks up colors from different samples. 



- 3 - 



each of which typically has an area smaller than the area of any 
displayed component. These picked-up colors are selectively filled 
in' the displayed components when the image is displayed. Color 
arrangements are changed by substituting other picked-up colors in 
5 the display of particular components. 

United States Patent 4,931,929 to Sherman for DESIGN COMPONENT 
SELECTION COMPUTER WITH SPECIFICATION OF PRODUCT CHARACTERISTICS AND 
OF COLOR BY MACHINE READABLE DEVICE concerns a process for 
identification, description and display of design components, such 
10 as interior decoration products, selected by describing desired 
component characteristics to a digital computer. An image database 
is provided, preferably in the form of an addressable optical 

□ videodisk, each frame of which portrays an individual design 

component, and the images are displayed by operation of a 

,M5 computer-controlled archive system such as a random-access optical 
videodisk player. A characteristics database is provided to 

1=2 characterize each portrayed design component by a variety of product 

"''4 categories including at least color, price, manufacturer and image 

database address. The process obtains one or more desired component 

ilgO characteristics, examines the characteristics database to identify 

\^ design components meeting the desired product characteristics, and 

displays the identified component images together with a complete 

O record of characteristics for each product. The desired color 

characteristic can be obtained by selection from a text dictionary 
25 of color identification terms, by machine inspection of a 
machine- readable color comparison sample, or by optical spectrum 
analysis of a pre-existing product sample. 

United States Patent 5,255,352 to Falk for MAPPING OF 
TWO-DIMENSIONAL SURFACE DETAIL ON THREE-DIMENSIONAL SURFACES 
3 0 concerns a system and method for providing surface detail to 
mathematically-defined three-dimensional surfaces which preserves 
the specific dimensional integrity of the surface detail image being 
mapped in order to provide dimensionally correct surface detail. 
This is accomplished by performing the intermediate step of mapping 



the surface detail image to a two-dimensional flattened pattern 
piece representation of the surface and thereafter mapping this 
representation to the three-dimensional surface. The system and 
method of the present invention may be used as one function of a 
greater three-dimensional computer aided design system for any 
industry which utilizes flat sheets of material formed or assembled 
into a finished product, including textiles, apparel, footwear, 
upholstered furnishings, automotive or interior design. 

United States Patent No. 5,601,431 to Howard for an INTERIOR 
DESIGN SYSTEM AND METHOD concerns an interior design system 
comprising a display assembly having three flexible transparent 
overlays, a plain background sheet hinged to corresponding edges of 
the overlays, and a template sheet hinged to a free edge of the 
background sheet and having "scale" background and foreground grid 
sections. All this is for assisting in laying out interior room 
decorator's designs with a comprehensive catalog of design elements 
printed with scale designs of perspective furniture and accessory 
designs, and architectural elements for creating the room space to 
be decorated. The catalog pages have rows of printed scale designs 
covered with transparent plastic, with overlying, selectively 
removable and replaceable design elements. The design elements have 
designs that are printed to the same scale on carrier sheets of 
flexible "static-cling" material. These carrier sheets are 
rectangular sections that are cut from a printed sheet the same size 
and shape as the backing sheet. In this manner, the catalog pages 
provide marked storage positions for the design elements after use. 

In addition, the backing sheets are marked with descriptive 
labels and special coded symbols in distinctive shapes and colors 
for assisting in selection and coordination of interior designs, and 
also are imprinted with generic labels for the designs. The method 
constitutes the steps of (i) providing the catalog of scale images 
and the background and foreground grid sections, (ii) labeling and 
coding the images for identification, coordination and storage, 
(iii) selecting candidate images from the catalog and transferring 
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them to the grid sections; (iv) applying the images in the desired 
positions and combinations, thereby to create a decorator's design, 
plus, optionally, (v) applying colors as an overlay on the completed 
design for a more complete rendering. 
5 United States Patent 5,940,806 to Danial for a METHOD AND 

APPARATUS FOR RECEIVING, STORING AND PROVIDING DATA CORRESPONDING TO 
GEOMETRICALLY DESCRIBABLE RAW MATERIALS concerns an apparatus and 
method employing a programmable computer for providing a list of 
data items corresponding to geometrically describable materials 
10 based upon a profile specified by a user. The list of data items is 
stored in a data base. Each data item includes geometrically 
descriptive terms and trading parameters identifying characteristics 

□ of an item offered for sale by an advertiser. A profile is 
j;^ generated by a user which includes geometrically descriptive terms 
£5 and trading parameters identifying characteristics of an item sought 

for purchase by the user. The profile identified by the user is 
Q compared to each data item stored in the data base and data items 

are identified which match the profile. The data item identified 
are provided to the user in accordance with the user's specific 
i;|0 delivery instructions. 

j^J=J United States Patent 6,005,969 to Thomas, et . al . , 

■=5 concerns METHODS AND SYSTEMS FOR MANIPULATION OF IMAGES OF FLOOR 

□ COVERINGS OR OTHER FABRICS that enable a highly streamlined and 
efficient fabric or textile sampling and design process. The 

25 sampling and design process is claimed to be particularly valuable 
in the design and selection of floor coverings, wall coverings and 
other interior design treatments. A digital library of fabric 
models is created, preferably including digitized full-color images 
associated with digital representations of positions that are 

30 located within, and which characterize, the models. Via an 
application implemented according to conventional software methods 
and running on conventional hardware having high resolution 
graphics-processing capabilities, a user may navigate among the set 
of alternative models, and may modify the positions of the selected 
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models to test out desired combinations of characteristics -- such 
as poms or yarn ends, or models of floor coverings and view the 
results in high resolution. A method is provided for substituting 
colors in digital images of photographic quality, while preserving 
5 their realism particularly in the vicinity of shadows. The 
resulting samples or designs can be stored and transmitted over a 
telecommunications network or by other means to a central facility 
that can either generate photographic-quality images of the samples, 
or can directly generate actual samples of the carpet or other 
10 material of interest . 



2 . 3 A Specific Previous Interior Design System Operative on a 
i;3 Private Satellite Down-link. Phone Line Up-link Communications 

:=n Network 

:=C The system and method of the present invention will be seen to 

':15 involve interactive communications across a digital communications 
Q network for the purpose of producing images that typically include 

furniture. At least one previous upholstered furniture 

customization system involves a real-time network-based interactive 
Co system for support of visualizing upholstered furniture prior to 

!jO placing an order for the upholstered furniture. 

p This existing interactive system of La-Z-Boy™ Incorporated, and 

□ possibly others, is available for use by sales associates in La-A- 

Boy™ furniture showrooms. The system permits prospective customers 
to preview La-Z-Boy furniture upholstered in La-Z-Boy offered 
25 fabrics. It requires a La-Z-Boy™ furniture item number, and a La-Z- 
Boy™ fabric number. The system then maps the fabric onto a static 
perspective view of the selected furniture item. 

To the extent of depicting furniture, this previous system is 
similar to the system and method of the present invention. However, 
30 the system used by La-Z-Boy™ is considerably different from the 
system of the present invention as to each of, inter alia, (i) 
system interaction (rote versus sophisticated) with the targeted 
user (a furniture salesman versus an interior designer) , (ii) how 
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the furniture images are generated and presented {2D versus 3D, and 
fixedly versus being shown in context) , (iii) the technical 
capabilities of the image generation (no provision for scaling, 
rotation and placement of upholstered furniture images into 
5 background scenes) , and (iv) the business model supported (retail 
store furniture promotion vs. a prof essional - level interior design 
tool supporting furniture selection, placement and procurement as 
well as promotion.) 

10 2.4 A Specific Interior Design System Operative on the Internet 
The system and method of the present invention will be seen to 
involve communications across a digital communications network, to 

□ wit: the Internet. At least one interactive design system 

'^5 evolved as a real-time network-based evolution of an older PC-based 

::f5 software program product -- already (circa 2000) exists on the 
Internet. This existing system is superficially similar to the 
system and method of the present invention. However, the existing 
'•^4 system is again considerably different from the system of the 

present invention as to each of, inter alia, (i) the targeted 

f§0 audience (amateurs versus professionals) , (ii) how the images are 

'•'it 

Ij: generated and presented (2D versus 3D) , and (iii) the business model 

supported (furniture and software promotion vs. prof essional- level 

□ design assistance, furniture promotion and procurement.) 

The existing interactive system is the called the cMyVision™ 
25 Free Internet design software for use in interior, exterior, home 
and landscape improvement. The cMyVision™ software is a product, 
and cMyVision™ web site a service, of Visual Applications, Inc. 
(VisApp) , headquartered in Kansas City, Missouri. (cMyVision™ is a 
trademark of VisApp.) VisApp is a publisher of personal 
30 visualization technology, with a web site at <http://www.visapp.com> 
of the year 2000. 

Use of cMyVision™ Free Internet design software for interior, 
exterior, home and landscape improvement initially requires a 
digital photo of a house, normally the client's own house. Into 



this 2D scene a 2D object is inserted from the cMyVision library, or 
database. The system of the present invention will be seen to 
differ in that, from two or more 2D views, a 3D model of the 
client's 3D space, replete with dimensions, is first constructed. 
Then this 3D space is populated with 3D objects such as furniture. 
Accordingly, the cMyVision system operates to produce two- 
dimensional (2D) images while the system of the present invention, 
employing full three-dimensional (3D) models of both scenes and 
objects, produces full perspective scene views. 

VisApp also sells a product called VisualPhile™ Personal 
Visualization Software, touted to support professional interior 
remodeling and design. 

VisualPhile™ is personal computer software with the same 
features as cMyVision™. It runs on a personal computer without an 
Internet connection, as its library is included with the program. 
It is primarily suited to providing photo-realistic visualizations 
of home remodeling as opposed to decorating projects. As in 
cMyVision™, a certain degree of photo-realism stems from the use of 
photographs for both rooms and built -ins, appliances and 
furnishings . 

However, there exist inherent limitations - arguably severe 
when applied to professional interior design --in both cMyVision™ 
and VisualPhile™ and their use of digital photographs. These 
previous systems (i) are not based upon 3D coordinates (as will be 
seen to be used in the present invention) , so furniture images have 
to be placed and scaled visually by the user; and (ii) the furniture 
objects are 2D images, so they cannot be rotated to match the angle 
of the room photograph (as will seen to be the- case in the present 
invention) . Therefore, in both cMyVision™ and VisualPhile™ , room 
photos must be taken from a specified perspective, as their 
furniture photographs are all taken from this angle. Moreover, 
(iii) because the furniture images are only photographs, and not 3D 
models, it is not possible to map fabrics on them. This last 
limitation cannot be mitigated and is highly significant in 
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professional interior design applications. 

2 . 5 Stand Alone Personal Computer Interior Design Programs 

A number of software programs are commercially available which 
support interior design. These programs generally run on personal 
5 computers and allow the user to design rooms, place furniture 
objects into rooms, change wall colors and furniture fabrics, and 
display the customized furniture in the decorated rooms. Custom 
Home 3-D Design and Decor, published by Sierra On-line, Inc., 5 in 
1 Home Design by Punch! Software LLC, and 3D Home Interiors by 
10 Broderbund all support most of these design-assistance and 
visualization objectives. In addition, numerous commercially- 

0 available programs support architectural rendering, including 
computer-aided design (CAD) programs like AutoCAD, which incorporate 
3-D functionality and therefore have application to interior design. 

Custom Home 3-D Design and Decor includes a program called 
p Photo Home Interiors™. This program, unlike the others, allows 

'-^ users to import photographs of actual rooms into the program, and 

then place furniture objects into the room images. The objects 
lO include 3-D furniture models, which can be rotated and scaled to fit 

;,So the scene. However, the room images are'^not associated with a 3-D 

1 y 

Q model of the room. In other words, while Photo Home Interiors™ does 

W= allow furniture objects to be shown as an overlay on top of room 

photographs, it lacks the capability of rendering furniture objects 
placed onto floor plans in photographically-derived scenes. 
25 Therefore, this program does not allow wall and floor coverings to 
be displayed in the proper perspective. In addition, the 3-D 
objects need to be visually scaled by the user to compensate for the 
perceived distance from the camera position. With this system, it 
is not possible to evaluate furniture objects of specific dimensions 
30 as to scale. For all of these reasons, is cumbersome to use on a 
personal computer, and would be even more so over a digital 
communications network . 

Furthermore, the furniture objects are generic and therefore 



I. 
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not available for purchase, no procurement features are available, 
the furniture and fabric database is very limited in quantity and 
quality. Finally, this program does not operate over a digital 
network . 

5 As a result of such limitations, even this program has limited 

professional application. These limitations in the prior art are 
overcome in the present invention, which incorporates proprietary 
technology developed to support this highly desirable functionality. 

2 . 6 Desirability of the Rendering of Images of Eyeglasses Upon the 
10 Head of the Actual Eyeglass Purchaser/Wearer /User 

New eyeglasses are difficult for consumers to evaluate, because 
G they may not be available in the sales showroom in the proper size, 

color or shape. In addition, many customers, especially those who 
,p are myopic (near-sighted) , can not clearly see the frames when 

1=^5 trying them on. 

O It would therefore be useful to permit optical businesses to 

'"4 interactively customize frame designs to complement the shape of 

}^ their customer's face, skin and hair color, and to permit their 

Co customers to see how such customized products look on a 

[pQ computer-generated image of themselves. Such renderings would 
1=5 desirably include lens tints and even the facial distortion imposed 

□ by the customer's actual lens design. Furthermore, profile and 

oblique views would permit customers to evaluate the merits of thin 
high refraction index materials, as well as to assess their own 
25 appearance to others while wearing the eyeglasses. 

Such a system would be a promotional tool, potentially 
expanding the number of frame offerings by several orders of 
magnitude or more (being that inventory in the form of virtual 
digital images costs veritably nothing) , and making a limitless 
30 virtual display rack available. Such a system would prospectively 
reduce the number of customers who walk out of an eyeglass sales 
store because they couldn't find a frame that they found attractive. 
Such a system would desirably support the sale of high-margin tints, 



high- index and progressive lenses, optical coatings, and a second or 
third pair of "fancy" glasses designed to complement fashionable 
clothing as the customer would be able to shop with confidence as to 
the appearance of these features. 

Regardless of the inducements to purchase provided by such a 
system, the system would indisputably reduce distribution and sales 
costs by eliminating the need for large frame display inventories 
and automating the procurement process. 

2 . 7 Existing 3D Image Capture Technology 

The present invention will be seen to beneficially employ in 
the generation of three-dimensional (3D) images of a human head a 3D 
image capture technology. Such a technology is commercially 
available, circa 2000, from Minolta Co., Ltd. in combination with 
MetaCreations, Inc., in the 3D 1500 camera product. The 3D 1500 is 
a complete hardware/software package that combines a quality Minolta 
digital camera with MetaCreation' s MetaFlash 3D image production 
technology. It allows creation of high-quality 3D models in 
MetaCreation' s MetaStream file format, which can be transmitted 
quickly over the network for further manipulation. 

Another example of a three-dimensional (3D) image acquisition 
system for deriving 3D models of the human head is the ShapeSnatcher 
3D-Toolkit from Eyetronics, Inc. After calibration, data can be 
captured within the time needed for a single photograph or frame. 
The 3D model is textured, with a perfect alignment between the shape 
and the texture. Skin color, marks or scars are visible as they 
would be on a photograph. 

SUMMARY OF THE INVENTION 

The present invention will be seen to have both (i) business 
and (ii) technical aspects. 

The business method of the present invention is based on a 
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software-based computerized system for both (i) interactively 
selecting and, if useful, customizing both objects and object 
environments, ultimately (ii) rendering composite perspective images 
-- which may be photo-realistic if desired --of the interact ively- 
5 selected and customized objects in the context of such image 
surroundings as are customary to the individual viewer, different 
viewers desiring and appreciating different customary surroundings. 
All (i) the interactive selection and (ii) the image rendering 
transpires across a communications network -- typically a worldwide 
10 digital communications network (the Internet) -- for purposes of 
advertising, promoting or selling the depicted objects in situ. 

The objects for which the images are generated are preferably 

□ not only products for sale, but products that are strongly 
^ beneficially best shown and appreciated in a context strongly 
SS relevant to an individual viewer, such as furniture within a 

person's own home, or eyeglasses upon a person's own head. 
Q The obj ect /product selection and image rendering service is 

'"-^ normally furnished for low or no cost upon a digital communications 

network, and preferably on the Internet, to bona fide design and/or 
ilOO medical professionals. The services are furnished to these 
LH professionals so as to help them (i) satisfy the desire of their 

□ customers to make informed and confident product selection and 
Q purchase decisions, so (ii) promote specific merchandise by showing 

it in an environment with which the prospective customer is both 

25 familiar and sympathetic, and (iii) make sales. 

The network provider of these services normally profits from 
being in the chain of commerce on such products, acting in any 
remunerative capacity from product advertiser to manufacturer to 
wholesaler to retailer. Note that, much like a modern supermarket, 

30 the imaging service provider serving as a middleman prospectively 
profits from both ends of the sales and distribution chain: (i) 
manufacturers and/or suppliers of goods pay in money, or in 
favorable prices for their goods, in order to have these goods 
interactively promoted, while (ii) the end purchasers of the goods 
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may also use the brokering and order placement services of the 
imaging service provider. 

Note that the object/product selection and image rendering 
service is preferably conducted interactively with professionals, 
5 and not with the end item product consumer. This is because the 
products that are most commonly and effectively promoted and sold 
are the opposite of commodities, and are normally any of "upscale", 
custom and/or expensive. The products are typically, and 
preferably, of a nature such that consumer discrimination and taste 
10 are involved in product selection which is exactly why the 

products are most successfully shown in an environment with which 
the consumer is familiar, and to which the consumer is receptive. 
□ Technically, the composite product image must be, and is, 

*== sufficiently accurate and appealing in showing the intended 

'MS environment of product use so as to induce a favorable opinion of, 

and/or purchase decision on, the product. However, and although 
13 the presented composite prospective image is accurate and of high 

"-=1 fidelity devoid of any glaring artifacts or incongruities, it need 

not be and typically is not photographically harsh, but can be, 
i^SO and generally is, somewhat romanticized and flattering, as through 
\}i a veil, or under flattering lighting. This is not difficult to 

ri accomplish -- once it is first recognized that it should be done, 

Q and that reality can be brutal. The system and method of the 

present invention is directed to simultaneously giving (i) a 
25 realistic image with an image background familiar to the consumer, 
and (ii) a pleasingly flattering image. The realism of the image 
may be further enhanced through the use of a system for measuring 
actual lighting illumination and shadows in photographically- 
derived background scenes. This will enable the rendered image to 
30 project similar lighting and shadows on the virtual objects. 

The interior design professional can aid in this process by, 
for example, subduing lighting in a less appealing portion of a 
room while dramatically highlighting proposed new furniture and 
decor. The medical professional can aid in the process by, for 
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example, improving the color tone of the subject, or^ the angle of 
view, or the color temperature of the lighting. 

1 . Image Compositing and Rendering, Including of Virtual Objects 
Interactively Over a Communications Net 
5 The technical method of the present invention is directed to 

the compositing of precisely-placed, rotated three dimensional 
("3D") objects of known size into photographically- or virtually- 
derived background scenes. To achieve this objective, a 
specialized rendering and compositing methodology was developed. 
10 In the case of photographically-derived background scenes, two or 

more photographs of the desired background scene, taken from 
O different angles, are obtained. The background scene may be, for 

;5 example, an interior room, or an exterior space, or even a human 

:=C head . 

;J5 Portions of the scene that are desirably preserved in an 

fj eventual scene rendering are selected and then removed or "cutout" 

'"~4 from the scene using standard image editing software. Then, a 3-D 

model of the altered background scene is created from the multiple 
ffi images using commercially available software. This involves 

;,20 identifying common points in each of the photographs, and the 
Q distance between two points. These positions allow the precise 

□ camera location for each image to be calculated, lens distortion 

to be reduced, and scale and an X-Y-Z coordinate system to be 
established. For example, for a scene of an interior room 
25 geometric primitives are overlaid onto each wall, floor and 
ceiling surface, including soffits and recesses. 

Next, scene objects -- like furnishings such as chairs, or 
awnings, or eyeglasses -- that are suitably incorporated in the 
respective scenes are selected from stock catalogs of these 
30 objects by a designer/selector. For both photographically-derived 
and virtually-derived background scenes, these objects -- for 
example furnishing objects like sofas -- are then placed into the 
3D model depicting the background scene. All objects are placed 
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and oriented where and as desired in the scene, and all desired 
surface coloration, textures, shadings, etc. are applied. 

Finally, a composite rendering is produced using proprietary 
software. The rendering projects the background scene and all 
5 objects therein in their proper or desired position, replete with 
lighting effects and shadows. Cutout objects are also included 
for photographically-derived scenes, as well as the background 
scene of one of the multiple images. 

As previously explained, the synthesized scene can 
10 potentially be, if desired, so realistic that it cannot be 

distinguished from reality save by a trained forensic "photo" 
analyst. However, the normal mode of the composite image 
rendering of the present invention is to make a geometrically 
spatially accurate perspective image, but not one so detailed and 
isotopically brightly lit so as to be suggestive of a picture of a 
laboratory, or of a criminal mugshot . Modern graphic imaging 

□ techniques readily permit making images less harsh and more 

subdued, and such techniques are used in the system of the present 
invention to good effect in accordance that no prospective 

ilOO purchaser of luxury goods should be too harshly confronted with 

the (visual) limitations of his or her purchase, or, worse yet, of 

Q his or her home, or, still worse yet, of himself or herself. 

In summary, a system is presented that allows customized 
virtual objects of known size to be interactively manipulated and 

25 placed into precise locations of photographically or virtually- 
derived scenes at the proper scale, over a digital network. Such 
"in context" interactive product displays are useful for 
evaluating visually attractive design concepts, and for product 
promotion and procurement. For example, existing and to-be- 

3 0 constructed rooms in both residential and commercial buildings, 

such as might be designed by professional interior designers, are 
proper subjects for the display system of the present invention. 
For example, the showing of virtual images of eyeglass frames upon 
the head of a prospective purchaser of eyeglasses is a proper 
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subject for the display system of the present invention. 

2 . A Method of Visually Presenting an Object Suitably Existing 

Within the Real World within a Scene Suitably Existing Within 
the Real World 

5 Therefore, in one of its aspects the present invention is 

embodied in a method of statically visually presenting an object 
suitably existing within the real world within a scene suitably 
existing within the real world. 

The method combines both (i) a selected 2D image representing 
10 an associated real -world scene in which the suitably real -world 

object can exist, and (ii) a selected name, or, preferably, a 2D 
P icon representing the suitably-real-world object, the 2D icon 

m appropriately sized to, and selectively located and aligned 

:=p within, the 2D representation of the selected real-world scene, 

:'_1;5 with (iii) a (generated) 3D model of the represented selected 
Q real-world scene, (iv) a 3D model of the iconically represented 

'"'■^ suitably-real-world object, and (v) object-based rules as to how 

is 

the suitably-real-world object exists within the real-world scene, 
W in order to generate (vi) a perspective view of the suitably-real- 

;,Mo world object properly located and oriented within the real-world 

scene. 

■:cr 

Thus selection of each of an icon, a 2D image of a real-world 
scene, and an icon location within the selected scene image, 
permits combining a 3D model of the real-world scene with yet 

25 another 3D model of the suitably-real -world object represented by 
the selected icon so as to generate a static perspective view of 
the selected suitably-real-world object located within the 
selected real-world scene. 

More simply put, image selection (s) transpiring entirely in 

30 2D supports generation of a (static) perspective view showing a 3D 
object within a 3D scene. Furthermore, the present invention 
allows this to happen with photographically-derived, as well as 
virtually-derived, scenes . 
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The method is preferably exercised to the purpose that a 
prospective purchaser of the real -world object may be rendered a 
perspective view of the object within a real-world scene in which 
real-world scene the object can actually exist. Still more 
5 preferably, the rendered perspective view may be of (i) furniture, 
and furnishings, within a room or of (ii) eyeglasses, including 
both frame and lens elements, upon a human head. 

In the case of a room image, the combining is then of (i) a 
selected 2D image representing a room, and (ii) a selected 2D icon 
10 representing a room furnishing, with (iii) a 3D model of the room, 
(iv) a 3D model of the furnishing, and (v) object-based rules that 
the furnishing is upon a floor or a wall of the room, in order to 
Q generate (vi) a perspective view of the room furnishing properly 

located and oriented within the room. By exercise of this method 
:=p5 a prospective purchaser of the real-world room furnishing may be 
J'^ rendered a perspective view of a suitably-real-world room 

Q furnishing properly located and oriented within a real-world room. 

The suitably-real -world room furnishing rendered in 
:==^, perspective view may already exist in the world, and can thus be 

l^gO ordered by the prospective purchaser. However, the depicted 

;=£ = 

IJf, furnishing may not yet exist in the world, existing only in 

rj virtual reality, and must therefore be built if and when ordered 

•■'•J by the prospective purchaser. 

In the case of the rendering of an image of eyeglasses, the 
25 combining is of (i) a particular 2D image representing a human 
head, and (iii) selected eyeglasses, with (v) a 3D model of the 
human head, (vi) a 3D model of the eyeglasses, and (vii) object- 
based rules (to the effect that temple pieces of the eyeglasses 
slip over ears of the human head that is the subject of the 3D 
30 model while each lens of the eyeglasses is properly located in 

front of an eye of the human head) , in order to generate (viii) a 
perspective, front or side view of the eyeglasses properly located 
and oriented upon and fitted to the human head. 

Note that the eyeglasses, unlike the furniture, are not 
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normally represented by an icon. Moreover, the eyeglasses, or 
more exactingly some eyeglass icon, is not positioned upon the 
human head. There may be a picture of each of many eyeglass 
frames, and the consumer may choose one to be illustrated in place 
5 upon his or her own head. However, the positioning of the 

eyeglasses upon the head is not by act of moving some eyeglass 
icon into a head image view, but by action of a model. More 
generally, it must be understood that the following claims of the 
present invention set forth the general steps of the invention for 
10 the interactive selection, and generation, of most images, 
including preferred step-by-step procedures for realizing 
preferred images of furnished rooms, or of eyeglasses fitted to 
Q the head. It is, however, possible to vary from the detail steps 

;S of some, or of all, claims without departing from the spirit of 

::p5 the present invention. Such is the case where (i) an icon, such 

as of furniture, moved into a 2D scene, such as of a room, to make 
Q a perspective image in which the furniture exhibits proper 3D 

'■^J placement, is alternatively equivalently realized by (ii) a 

selected name, such as of eyeglass frames is combined with a 3D 
CQO model of eyeglass placement upon the head so as to make a 

perspective image in which the eyeglasses exhibit proper 3D 
rj placement. A practitioner of the imaging arts will recognize the 

O equivalence of these processes, mutatis mutandis. 

By this imaging a prospective purchaser of the real -world 
25 eyeglasses may be rendered a perspective view of the eyeglasses 

properly located and oriented upon, and fitted to, the purchaser's 
own human head. As before, the suitably-real-world eyeglasses 
rendered in perspective view may already exist in the world, and 
can be immediately shipped to a prospective purchaser. However, 
30 it is also possible that the frames of the suitably-real-world 
eyeglasses rendered in perspective view do not yet exist in the 
world, and must be custom built when ordered by the prospective 
purchaser . 
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3 . An Interactive Method of Promoting and Selling Real -World 
Obi ects 

In another of its aspects the present invention is embodied 
in a method of doing business: an interactive method of promoting 
5 and selling real-world objects. 

A principle variant of the preferred method commences by 
originating at a server upon a digital communications network (1) 
a first plurality of 2D images depicting real-world scenes, (2) a 
second plurality of 2D images depicting real-world objects, (3) a 
10 third plurality of icons corresponding to the second plurality of 
images depicting real-world objects, (4) a fourth plurality of 3D 
models corresponding to the scenes that are depicted within first 
□ plurality of 2D images of real-world scenes, (5) a fifth plurality 

^ of 3D models corresponding to the objects that are depicted within 

:M5 second plurality of 2D images of real-world objects, and (6) a 

sixth plurality of object-based rules. 
Q Selected members of each of the (1) first plurality of 2D 

-4 images of real-world scenes, the (2) second plurality of 2D images 

of real-world objects, and the (3) third plurality of icons 
i'gO corresponding to the second plurality of images of real -world 
objects are first-communicated from the server upon a digital 
i'3 communications network to a client. 

U The client selects a (la) selected real-world 2D scene image 

from among the (1) first plurality of images, and a (3a) selected 
25 icon from among the (3) third plurality of icons which (3a) 

selected icon does correspond to a (2a) selected real-world object 
image from among the (2) second plurality of real -world object 
images . 

The (3a) selected icon within the (la) selected real-world 2D 
30 . scene image is sized and placed at the client's computer by 
operation of a computer program. 

This sized and placed (3a) selected icon within the (la) 
selected real-world 2D scene image is second-communicated from the 
client upon the digital communications network to the server. 
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The server selects under program control from among the (4) 
fourth plurality of 3D models a (4a) 3D model of the real-world 
scene corresponding to the (la) selected real-world 2D scene 
image, and from the (5) fifth plurality of 3D models a (5a) 3D 
5 model of the real -world object. 

The server then generates from the (4a) 3D model of the real- 
world scene, the (5a) 3D model of the real-world object and the 
(6) plurality of object-based rules, a (7) static perspective view 
of a (7a) 3D real-world object corresponding to the {3a) selected 
10 icon properly located and oriented within a (7b) 3D real-world 
scene corresponding to the (la) selected real-world 2D scene 
image , 

□ Next, the server third-communicates this generated (7) static 
perspective view upon the digital communications network to the 

Ms client. By and from this third-communicated (7) static 
'fi perspective view, the {7a) 3D real-world object properly located 

Q and oriented within the (7b) 3D real -world scene may be observed 

'--^ at the client. 

The client fourth-communicates upon the digital 
!;20 communications network to the server a sales order, lodging with 
\^ the server an order to physically provide a real specimen of the 

rj (7a) 3D real-world object. Obtaining the sales order for the (7a) 

□ 3D real -world object is thus promoted by showing the (7) static 
perspective view at the client, which static perspective view 

25 contained the (7a) 3D real-world object properly located and 
oriented within the (7b) 3D real-world scene. 

In its preferred application, this interactive method of the 
present invention is exercised for selling real-world objects. 

For example, room furnishings and furniture may be imaged and 
30 advertised and/or sold. In this application the server originates 
(1) a first plurality of 2D images depicting rooms, (2) a second 
plurality of 2D images depicting furnishings, (3) a third 
plurality of icons corresponding to the second plurality of 
furnishing images, (4) a fourth plurality of 3D models 
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corresponding to the rooms that are depicted within first 
plurality of 2D room images, (5) a fifth plurality of 3D models 
corresponding to the furnishings that are depicted within second 
plurality of 2D furnishing images, and 
5 (6) a sixth plurality of rules regarding how furnishings fit 

within rooms. In this application the server first-communicates 
upon the digital communications network to the client selected 
members of each of the (1) first plurality of 2D room images, the 
(2) second plurality of 2D furnishing images, and the (3) third 
10 plurality of furnishings icons. 

In this application the client selects a (la) selected real- 
world 2D room image from among the (1) first plurality of room 
Q images, and a (3a) selected furnishing icon from among the (3) 

j5 third plurality of furnishing icons, which (3a) selected 

:.E5 furnishing icon does correspond to a (2a) selected furnishing 

1=2 image from among the (2) second plurality of furnishing images. 

y i 

Q The (3a) selected furnishing icon within the (la) selected 2D room 

'"J image is sized and placed at the client. 

}=j The client second communicates to the server upon the digital 

L-SO communications network the sized and placed (3a) selected 
!^j=5 furnishing icon within the (la) selected 2D room image. The 

Q server selects from among the (4) fourth plurality of 3D models a 

O (4a) 3D model of the room corresponding to the (la) selected 2D 

room image, and from the (5) fifth plurality of 3D models a (5a) 
25 3D model of the furnishing corresponding to the (3a) selected 

furnishing icon, and generates from the (4a) 3D room model, the 
(5a) 3D furnishing model and the (6) plurality of furnishing 
rules, is of a (7) static perspective view of a (7a) 3D furnishing 
corresponding to the (3a) selected furnishing icon properly 
3 0 located and oriented within a (7b) 3D room corresponding to the 
(la) selected 2D room image. 

Further in this application, the server third-communicates 
upon the digital communications network to the client the 
generated (7) static perspective view, and from this third- 
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communicated (7) static perspective view the (7a) 3D furnishing 
properly located and oriented within the (7b) 3D room may be 
observed at the client. 

Finally in this application, the client fourth-communicates 
5 the sales order to the server upon the digital communications 

network, the sales order directing physically provision of a real 
specimen of the (7a) 3D furnishing. Thus a sales order for the 
(7a) 3D furnishing has been promoted by the (7) static perspective 
view showing at the client the (7a) 3D furnishing properly located 
10 and oriented within the (7b) 3D room. 

Typically at least one of the server's first, second and 
third pluralities of images is proprietary, and more typically all 
Q these first, second and third pluralities of images are 

,S proprietary. 

=£5 The originating server may further offer (8) a set of 

available lighting effects, thus making that the first 
□ communicating from the server upon a digital communications 

^'"^ network to the client is further of the (8) set of available 

lighting effects, the selecting at the client is further of a (8a) 
;;0O selected lighting effect from among the (8) set of lighting 
\^ effects, the second communicating from the client upon the digital 

r^, communications network to the server is further of the (8a) 

selected lighting effect, the generating at the server is further 
of the (7) static perspective view as illuminated by the (8a) 
25 selected lighting effect, and the third communicating from the 

server upon the digital communications network to the client is of 
the generated (7) static perspective view as illuminated by the 
(8a) selected lighting effect. 

Likewise, the originating server may further offer of (8) a 
30 set of available textures and colors. The first communicating 
from the server upon a digital communications network to the 
client is then further of the (8) set of available textures and 
colors, the selecting at the client is further of a (8a) selected 
textures and colors from among the (8) set of textures and colors. 
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the second communicating from the client upon the digital 
communications network to the server is further of the (8a) 
selected textures and colors, the generating at the server is 
further of the (7) static perspective view as textured and colored 
5 by the (8a) selected textures and colors, and the third 

communicating from the server upon the digital communications 
network to the client is of the generated (7) static perspective 
view as textured and colored by the (8a) selected textures and 
colors . 

10 Most preferably in exercise of the interactive method for 

selling furnishings, the selecting, including of lighting effects 
and colors and textures, is performed by an interior designer at 

y the client. 

up 

m Strongly preferably in exercise of the furnishings sales 

-£5 method the generating produces a 3D virtual image of the room 

'7'i where all textures are scaled and oriented to the three- 

Q dimensional objects in which the textures appear. 

'""■^ This interactive method in accordance with the present 

Q invention for selling furnishings may be still further expanded in 

^io that, between the third communicating and the fourth 

rU 

\s\ communicating, the interior designer at the client may fifth- 

Q communicate upon the digital communications network a request for 

a real physical sample of something in the generated and displayed 
3D image of the room with furnishings. This requested sample is 
25 normally physically providing to the interior designer to help 
promote the sale. 

The fifth-communicated request for a physical sample may be 
of any of a fabric swatch, a wallpaper sample and the like. 
As with the display generation method of the present 
30 invention, the (7a) 3D image may be of a furnishing that does not 
yet exist in the real world, and exists only in virtual reality 
(as designed in three dimensions by a designer) . In this case 
after the fourth-communication of the order, a real copy of the 
(7a) 3D imaged furnishing which has, until acceptance of the 



order, never existed save as a virtual image, will be fabricated 
and delivered. 

An analogous, and similar, application of the method of the 
present invention is to show an exterior space, such as a building 
or courtyard or yard. Note the slight differences. The model of 
the space that is uploaded does not define an interior space (a 
room) in which objects will be placed, but rather an exterior 
space or scene into which objects will be placed. The dimensions 
of this exterior space must again be communicated so as to 
properly show the relative sizes of objects sited in the space. 
One effective way of communicating information regarding this 
space is simply to transmit at least two, and potentially many 
more, plan digital images ("pictures") of the space. At least one 
distance commonly visible in at least two images is specified. 
From these images, and with the identification of matching points, 
the software running in the server computer is able to derive key 
elements of a 3D model of the exterior space, including its 
scale . 

Yet another analogous, and similar, appl ication of the method 
of the present invention is to show eyeglasses upon the head of a 
prospective purchaser. Again note the slight differences. The 
model of the space that is uploaded does not define an interior 
space (a room) in which objects will be place, but an exterior 
scene (a head) upon which objects will be placed. The dimensions 
of the model scene the head -- are important to show, among 
other things, the size of the eyeglasses and lenses. One 
effective way of communicating 3 -dimensional information regarding 
the customer's head from the client computer, as may be for 
example located in the office of an optometrist, to the server 
computer in order that a 3D model of the head may be made is 
simply to use a commercially-available product designed for this 
purpose. With information provided by such 3 -dimensional model 
capture device, software running in the server computer is able 
to generate a properly scaled and photographically- textured 3D 
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model of the customer's head, and all pertinent measurements such 
as, for example, the depth from the bridge of the nose to the ear 
(as relates to the temple pieces of eyeglass frames) . 

Still further, the application of the method of the present 
5 invention to the selection and imaging of eyeglasses preferably 
involves specification of both (i) frames and (ii) lenses. The 
lenses are specified by the optometrist across the communications 
network to the server computer so that they, as well as the 
frames, may be alternatively illustrated as made thinner from high 
10 index of refraction materials or thicker from low index of 

refraction materials, of tinted, or beveled, etc. It must be kept 
in mind that a cheap and comically distorted or unrealistic image 
is not desired. The computer software used in automated 
production of the image is, although substantially pre-existing, 

..55 large and extensive; the computer hardware is powerful; and the 

accounting for image artifacts -- such as reflections and bending 

□ of light by the lenses accounted for by ray tracing extensive. 

'"-^ The image generation process is resource intensive, but (i) the 

ii 

1=2 extensive resources used to produce the image are shared, and (ii) 

iiSo the image is static. According to these constraints, the image is 

not produced in real time as might suit, for example, an animated 
Q computer game, but is of exceedingly high quality, as suits its 

O purpose . 

4 . A Method of Interactive Advertising 

25 In still another of its aspects the present invention is 

embodied in a method of interactive advertising. 

The method consists of delivering to a prospective customer 
of some customer-selected product a virtual image of the product 
located within virtual scene, the virtual scene permissively 

30 including still other virtual objects. This delivering arises 
from first-interacting upon a digital communications network 
between (i) a server computer having a first palette of virtual 
images of scenes, and a second palette of virtual images of 
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products and objects, and (ii) a client computer where the 
prospective customer selects (1) a scene image from among the 
server computer's first palette, and also (2) at least one product 
image, and other object images, from the server computer's second 
5 palette. This first-interacting is so as to (i) locate the 

product, and object, images within the scene image, and also so as 
to (ii) produce at the server computer to the prospective customer 
a image of a customer-selected scene in which appears images of a 
prospective-customer-selected product and other selected objects. 
10 The prospective customer at the client computer thus 

interacts upon the digital communications network and with the 
server computer to interactively produce a scene in which the 
Q customer-selected-product is advertised. 

This method of interactive advertising may be exercised so as 
:=p5 to deliver to the prospective customer a virtual image of a 

furnishing located within a virtual scene of a room, replete with 
p virtual images of other room furnishings. In such a use the 

'"'■^ prospective customer interacts to produce a scene in which the 

;^=- customer-selected furnishing product is advertised. 

iiflO This method of interactive advertising may be exercised so as 

[j^ to deliver to the prospective customer a virtual image of a tree, 

Q shrub, flower or the like, or a patio or a wall or the like, or 

O shutters or windows or the like, or a barbecue grill, tables, or 

chairs or the like, located within an outdoor scene, replete with 
25 and existing landforms and improvements upon the land. In such a 
use the prospective customer interacts to produce a scene in which 
the customer-selected landscaping, and/or natural or man-made 
artifacts that may be introduced into the scene, are advertised. 
Alternatively, the method of interactive advertising may be 
30 exercised so as to deliver to a prospective customer a virtual 
image of some object or objects -- clothing or a bicycle or 
eyeglasses or whatever -- located on or near to the body or body 
parts of the customer. The virtual objects in the image may be 
accompanied by images of real objects, or virtual body parts 



i 
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and/or body forms. The prospective customer thus interacts to 
produce a scene in which he or she himself or herself is featured 
in the scene along with the advertised product. 

Alternatively, the method of interactive advertising may be 
5 exercised so as to delivering to the prospective customer a 

virtual image of a vehicle located within a virtual outdoor scene, 
in accompaniment to virtual images of other vehicles. The 
prospective customer thus interacts to produce a scene in which 
the customer-selected vehicle product is advertised. 

10 In any use of the method of interactive advertising, after 

delivery of the image the method may continue with fulfillment by 
making a real copy of the displayed customer-selected-product 

□ which has, until acceptance of the order, never existed save as a 

virtual image. 

';MS These and other aspects and attributes of the present 

invention will become increasingly clear upon reference to the 
''--4 following drawings and accompanying specification. 

l3 

i.LI 

BRIEF DESCRIPTION OF THE DRAWINGS 

O Referring particularly to the drawings for the purpose of 

20 illustration only and not to limit the scope of the invention in 
any way, these illustrations follow: 

Figure 1, consisting of Figures la and lb, shows a high-level 
flow chart of the interactive method of a representative 
embodiment of the present invention for computerized composition 
25 and display of perspective images of real or virtual three- 
dimensional objects located in, surrounding or in front of real or 
virtual three-dimensional scenes, particularly images of (i) the 
interior decor of rooms or (ii) eyeglasses upon a prospective 
customer's head. 

30 Figure 2 shows a flow chart expanding certain functions shown 
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within the flow chart of Figure 1, particularly the uploading and 
processing of user-supplied digital room images. 

Figure 3 shows a flow chart expanding the functions related 
to selecting objects and textures. 

Figure 4 shows a flow chart expanding the functions related 
to ordering swatches. 

Figure 5 is a diagram of a screen view, and associated 
selectable control functions, presented to a viewer/operator, most 
typically an interior designer, by the system and method of the 
present invention, particularly including an example browser 
screen view used to specify furniture objects and their locations. 

Figure 6 is a diagram of a screen view which is a continued 
from the view of Figure 5. 

Figure 7 illustrates the interactive advertising method of 
the present invention by use of a diagram of a perspective view 
image as may be rendered by the system and method of the present 
invention, particularly, and by way of example, an interactive 
automobile advertisement . 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Although specific embodiments of the invention will now be 
described with reference to the drawings, it should be understood 
that such embodiments are by way of example only and are merely 
illustrative of but a small number of the many possible specific 
embodiments to which the principles of the invention may be 
applied. Various changes and modifications obvious to one skilled 
in the art to which the invention pertains are deemed to be within 
the spirit, scope and " contemplation of the invention as further 
defined in the appended claims . 

1 . Application and Benefits of the Present Invention 

In accordance with the present invention, a business based on 
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provision of scene composition services and/or scenes and/or 
product images is a sort of Internet-accessible computerized 
graphics service provider. However, it must be emphasized that 
the preferred business model of the present invention is 
5 preferably not based on selling scene composition and imaging 
services, but rather on providing these valuable and useful 
services free to legitimate enrolled scene image designers 
whether these scene designers are, for example, interior designers 
or opticians -- in order that the objects selected for inclusion 
10 in the scene such as furniture or eyeglass frames -- may 

ultimately be sold, or even made, by the image producer. The 
image designers benefit from their participation in the 
□ interactive scene design in that they are able to better show the 

•ft products to their customers, concluding sales more rapidly and 

MS efficiently with greater customer satisfaction. 

The present invention is intended for application in a 
1=2 business- to-business electronic marketplace (e-marketplace) . It 

"'"-4 is primarily directed to interactively promoting products of 

visually attractive design. Although usable by diverse 
i:gO businesses, the present invention is contemplated to be of 

greatest value to large multi-store retail chains, and specialized 
Q business- to-business e-marketplaces, where products like 

Q eyeglasses, or groupings of products like furnishings and art work 

can be visually selected, customized and evaluated in context 
25 The technology of the present invention permits products, 

such as furnishings in a luxury residence or corporate office, to 
be manipulated as to rotation and position, and displayed in 
scenes derived from customer-supplied photographs or CAD sources. 
Displayed products can then be simply and collectively procured, 
3 0 eliminating the common errors and expense associated with complex 
multi-manufacturer procurement over phone and facsimile. 
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1 . 1 Application and Benefits of the Present Invention to Interior 
Design 

In one embodiment the present invention may be used by 
interior design professionals. This large wholesale market is 
5 ideally suited to web-based intermediation because: 1) both buyers 
(designers) and sellers (manufacturers and distributors) are 
fragmented; 2) nearly all mid- to high-end furniture products are 
highly customized and therefore made- to-order (minimizing the need 
for inventory); and, 3) given the state of year 2000 digital 
10 network infrastructure, the proposed business can only exist on 
the web, and requires specialized and proprietary visualization 
technology. 

0 The web-based application and tool of the present invention 
^ permits designers and their clients to select, customize and 

:=E5 rearrange groupings of furnishings to see how they will look 

1 ; 3 

within the client's actual room. The complete system and tool of 
n the present invention includes each of (i) a large on-line catalog 

containing 2D images and information for textures and furnishings, 
which may include fabric, wallpaper, paint colors and finishes, 
i'gO wood finishes upholstered furniture, case goods, art, art objects 
\^ and decorative accessories, (ii) a library of stock 3D room models 

□ that may be interactively sized, an interactive 3D room model 

□ generator containing a floor plan tool, and (iii) a library of 
proprietary 3D furnishings models. 

25 By manipulating designer- supplied CAD drawings or 

photographic images of actual rooms with the software tool of the 
present invention, designers will be able to simply and quickly 
produce photo-realistic images of their vision. Features 
including lighting effects and highly detailed models of 

30 furnishings permit the rendered, composite images to appear 

photo-realistic. While design professionals will occasionally 
build or render their own models, such projects are very time 
consuming, and require hours of rendering time on personal 
computers. The interactive, real-time visualization of an entire 
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room of furnishings, wall and floor coverings, art objects and 
accessories accorded by the system and method of the present 
invention is not otherwise, to the best knowledge of the 
inventors, currently available anywhere (circa 2000) . 
5 In use of the system and method of the present invention 

interior designer and architect members will (1) research, (2) 
design, (3) render, (4) market, (5) sell and (6) manage. 

To (1) research, interior designer and architect members will 
(i) identify and examine product offerings and customization 
10 options; (ii) utilize zoom technology to examine high- resolution 
product photos in great detail, (iii) utilize a large on-site 
reference library of searchable room images, (iv) participate in 

□ surveys, chat sessions and obtain confidential and anonymous 
feedback on design ideas; and (v) view industry news and views. 

,/I5 To (2) design, interior designer and architect members will 

(i) use the powerful web-based graphical user interface and 
1=2 visualization tools of the present invention to virtually decorate 

"'■4 interior spaces for residential and some commercial and 

'L entertainment applications to professional standards; (ii) create 

i;§0 a project color palette, and use it to identify fabrics, rugs, art 

work, accessories and wood finishes; (iii) select and then view 
p2 fabrics and finishes at high magnification to see intricate detail 

□ by utilizing zoom technology; (iv) apply a large selection of fine 
fabrics and finishes to intricate 3D models of furniture, pillows 

25 and cushions to create a composite image of the room being 

decorated, all by use of a simple graphical user interface (v) 
order swatches, and (vi) design and "see" private-label high-end 
custom cabinets and entertainment centers in various sizes, 
configurations, styles, veneers and finishes. 

30 To (3) render, interior designer and architect members will 

(i) specify lighting, camera position and other rendering options; 

(ii) create photo-realistic renderings of their designs which 
incorporate photographs or CAD drawings of the actual rooms being 
decorated; and (iii) order large high-resolution image files or 
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color prints of the photo-realistic renderings produced on the web 
site of the imaging service provider. 

To (4) market, interior designer and architect members will, 
by use of a password-protected private gallery, showcase 
5 renderings of completed projects to prospective clients. A zoom 
tool will be available here as well, to aid viewers in examining 
areas of the image they wish to view in greater detail. 

To (5) sell, interior designer and architect members will 
show quality screens and prints of proposed designs to their 
10 clients to help these clients "see" how their rooms will look with 
new furnishings, thereby helping these interior designers and 
architect members to win client approval to proceed with 

0 high-budget projects. 

To (6) manage: interior designer and architect members will 
:;I5 (i) generate project budgets, track purchase orders, delivery 
schedules and generate client invoices; (ii) order customized 
Q products showcased on the site, including furniture, rugs, wall 

'="-1 paper and accessories . 

P-^ In addition, dealers and manufacturers represented on the web 

;|30 site will be able to test market product designs, gather market 
i^^; data and provide static or interactive advertising to targeted 

1 y 

i;3 buyers. They will also benefit from the automation inherent in 

□ the research, procurement and related systems. 

The web site of the imaging service provider will also 

25 provide personalized industry community and content. This fully 

integrated platform will empower interior designers and architects 
with unprecedented visualization and communication tools, while 
simultaneously supporting all critical back-office functions. 
Thus the present invention supports operation of a service 

30 business, while outsourcing manufacturing. 

It is expected that use of the imaging of the present 
invention at an associated imaging services web site will 
significantly improve the productivity of interior design 
professionals. The imaging services site is intended to be a one 
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stop project management and purchasing system which will improve 
client communications, and save designers considerable time in 
identifying sources, selecting and specifying products, developing 
and communicating designs, obtaining fabric samples, and managing 
5 the vendor relationship and procurement process. 

1 . 2 Application and Benefits of the Present Invention to the 
Display of Art Work 

In another embodiment the present invention may be used by 
makers and sellers of fine art. Art work of all kinds, including 
10 sculpture, paintings, picture frames, lamps and accessories may 

usefully be visually evaluated in the context of other 
P furnishings, art work and architecture. This the present 

invention provides. 

'fz, 1 . 3 Application and Benefits of the Present Invention to the 

135 Selection of Eyeglasses 

New eyeglasses are difficult for consumers to evaluate, 
because they may not be available in the showroom in the proper 
lO size, color or shape. In addition, most customers can not clearly 

i;!^ see the frames when trying them on. 

rgO The technology of the present invention permits optical 

businesses to interactively customize frame designs to augment the 
shape of their customer's face, skin and hair color, and allow 
their customers to see how such customized products will look on a 
computer-generated image of themselves. Such renderings include 

25 lens tints and the facial distortion imposed by the customer's 

actual lens design. Furthermore, profile views permit customers 
to evaluate the merits of thin high refraction index materials. 

The system of the present invention so used excels as a 
promotional tool. It typically permits expanding the number of 

3 0 frame offerings by an order of magnitude or more, making a 

limitless virtual display rack available. The present invention 
will reduce the number of customers who walk out of the shop 
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because they couldn't find a frame that they found attractive. 
The present invention supports the sale of high-margin tints, 
optical coatings, high- index and progressive lenses, and a second 
or third pair of "fancy" glasses designed to complement 
5 fashionable clothing. The present invention also stands to reduce 
distribution and sales costs by (i) eliminating the need for large 
frame display inventories and (ii) semi -automating the procurement 
process . 

2 . General Description of Application of the Present Invention 
10 to Interior Decoration 

The present invention contemplates both (i) a business method 

□ of supporting design professionals including manufacturers and 
j'p representatives, and particularly interior designers and 

,S decorators, in the realistic visual display of both real and 

:^J5 virtual images of complex three-dimensional objects, particularly 

Q wall and floor coverings, art work, lighting fixtures, decor 

''J accessories, building products and furniture (herein collectively 

referred to as "furniture" or "furnishings" in the context of 
i;o rooms both real and virtual, to the ends of assisting the designer 

iJO identify, specify and procure products and develop a pleasing 
r5 design; and of permitting client viewing and endorsement of the 

□ interior designs and of rooms themselves as in the case where a 
home purchase is contemplated, and (ii) an improved three- 
dimensional image composition, display and procurement system and 

25 method, especially as serves to display the decorated rooms of 

buildings, especially as such furnished room images are created by 
professional interior designers. The image creation transpires 
interactively, on a digital communications network. 

The visualization method of the present invention is 

30 distinguished in that it allows the compositing of precisely- 
placed, rotated and manipulated (such as, for example, colored or 
"upholstered") 3D objects of specific size into photographically- 
derived background scenes at their proper scale over a digital 
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network. Products such as Photo Home Interiors™ also allow the 
compositing of 3D objects into photographically-derived 
backgrounds, but not with precise placement, or at the proper 
scale, or over a digital network. Such images are rendered in 3D 
5 and built from 3D objects that are each (i) chosen, (ii) placed, 
(iii) oriented and (iv) manipulated while in a two dimensional 
form. This approach is used by programs such as by the Sierra 
Home Architect 3.0 (a component of Custom Home 3D Design and 
Decor), for objects projected onto virtually-derived backgrounds. 
10 However, this program does not support photographically-derived 
background scenes- -it is basically a CAD program. Choice, 
placement, orientation and manipulation of the two dimensional 

□ images is commonly performed, by way of example, by an interior 

designer. Although the designer uses his or her skill in each of 
the selection, three-dimensional placement and orientation, and 
manipulation of items (typically floor and wall coverings, art 
work and furniture) in the room, the designer need not be 

'^J concerned with any three-dimensional, wire frame models of the 

images, nor with any of the mechanics of rendering the scene of 

iifO the furnished room in three dimensions. Accordingly, the designer 
remains such, and is not forced to become a 3D computer graphics 
engineer to use the system, and the method, of the present 

O invention. 

Nonetheless to be assembled with but a modicum of computer 

25 graphics skills by using a mouse to point, manipulate and select 
attributes of simple 2-D images, the 3-D images produced by the 
present invention are of high quality. Complex 3D objects such as 
pieces of furniture appear in the room images adjusted in 
location, size, angular rotation as these objects would actually 

3 0 appear within the 3D volume of an actual room. Even the 

orientation and scale of fabric coverings, as well as selectable 
colors, are true to reality. Light ray tracing is preferably 
performed from actual outdoor and indoor sources of light into, 
and in, the room. The resulting composite, virtual reality, image 



- 36 - 



is very much like a quality photograph of, typically, a decorated 
room, and more typically an expensive and elegantly-decorated room 
as might commonly be within a luxury private home or mansion. 
Nonetheless that the image looks completely "real", it may show 
5 objects, most commonly custom furniture, within rooms that may or 
may not yet be built, or at least are not yet lighted as within 
the computer-generated image. 

The powerful imaging of the present invention is coupled to 
the service of a new method of doing business: a method of 
10 researching, promoting and procuring products represented by 3D 
objects (including objects not yet existing) by accurately 
depicting these objects in the context of their actual sites 

□ (background scenes) and actual use. The imaging process is 
interactive. Most commonly, a professional interior designer (1) 

,,£5 will choose, create or provide a two-dimensional (2D) floor plan 
'fi representation of a room, and (2) will access it across the world 

Q wide web along with a proprietary database of two-dimensional 

■'--I images (and invisibly associated 3D models) of furniture, 

including large amounts of custom furniture that is yet to be 
igO fabricated. If provided, the (1) 2D room images may be of (la) a 
[5=5 real room, provided as a set of two or more digital photographs 

taken from different angles with commonly- identifiable points such 

□ that a computer may determine the camera positions and recognize 
the perspective on, and dimensions of, the room, or (lb) a virtual 

2 5 room, such as can be provided from a CAD/CAM program. 

In the (lb) case, the designer provides some simple 
information about the selected virtual room image, such as the 
dimensions of the room, the 3D location from which the room is to 
be viewed (the eye, or camera, location), and the source (s) and 

30 type(s) of illumination desired for the rendered room image. 

The designer may enhance and customize portions of the 
rendered room image, such as by virtually hanging 2D pictures or 
wallpaper, or inserting 2D windows or doors, by making alterations 
to a 2D representation of the 3D room model, such as a floor plan. 
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Similarly, the designer chooses 2D images of, inter alia, 
furniture, (i) placing 2D iconic representations of these images 
into appropriate points within the room with mouse clicks, and 
then (ii) indicating the desired three-dimensional rotational 
5 orientation of the real (3D) items associated with the 2D icons so 
placed. The designer runs a browser program at a client computer 
so as to interact across the world wide web with a software 
program operating on a server to, eventually, produce a 2D 
composite rendered image of the room. 
10 In greater detail, the designer clicks on an icon, which is 

most normally a small eye-level front-view picture, of a selected 
item of, typically, furniture, and then clicks on a desired 
S location within a floor plan or other schematic representation of 

.S a room image. This process generates top-view icons that are 

:.p5 automatically sized to the scale of the floor plan. Normally only 

two room coordinates need be specified, the computer knowing from 
Q the icon (of a chair, or table, etc.) that the object is to be 

placed upon the room floor. The designer will preferably indicate 
..==^ the desired rotation of the icon. Again, only one rotational 

iigO coordinate (relative to a cardinal direction of the room which is 
normally straight into the viewer screen) of from 0-360*^ is 

ru 

□ required because the computer knows from the selected icon that 

O the object is being direct ionally oriented upon the floor. The 

end result is a 2D (floor plan) image of a room in which are 

25 placed properly sized and oriented 2D (top view iconic) images of 
furniture. Although the image is rather flat and lifeless -- much 
like paper clothes might be pinned on paper dolls -- and a top 
view iconic image of, for example, a chair oriented to face away 
from the viewer is most certainly not the same as an image of the 

30 back of the chair, the image is useful in evaluating the placement 
and orientation of the furniture represented by the icons. 

Then, in accordance with the present invention, the designer 
can and will direct that the entire room image, including all 
contents, be rendered in three dimensions. This 3D image 
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rendering is, in accordance with the present invention, performed 
by an image graphics program that is most typically run in a 
powerful computer, and even then most typically over a period of 
up to several minutes. The resulting image rendering is, however, 
5 very useful in supporting the interior design process. 

Furthermore, because (i) complete and proper dimensional 
information for the room is provided by the designer/user and is 
incorporated within the 3D models of the placed objects (the 
furniture), because (ii) simple rules -- such as that furniture 
10 should sit upon the floor -- are adhered to in the image rendering 
process, and because (iii) realistic scene illumination is 
provided by rendering methods such as ray tracing, the rendered 3D 

□ image is of high quality, resembling a large color photograph of a 
^ completely realistic room. 

::55 The designer normally then seeks approval of his or her 

design vision by having his or her client view this generated 
Q image, iteratively making such changes and regenerating the image 

■"-^ as proves necessary. 

When the interior design of the room is both complete and 
i;@0 agreed upon by the interior designer's client, the designer will 
LH typically place an order with the image generation service for 

Q some or all of the items -- most commonly furniture -- depicted 

□ with the 3D image. The image generation service is thus directly 
making money for the provider of the service as a wholesaler, 

25 manufacturer's representative or jobber, of furnishings and 

building products like tile or wall paper, or as an agent for 
artists creating custom furnishings or accessories. 

The interior designer may pay a small charge for image 
rendering services provided, but this charge is typically either 

30 de minimis or foregone entirely if and when the designer places 
orders with the image generation service for the delivery of 
furniture. In accordance with the present invention, facilitating 
the sale of furniture is the primary source of revenue to the 
image generation, promotion and procurement service. The image 
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generation service may also charge furniture manufacturers a 
nominal fee to create and display images of the manufacturer's 
furniture -- especially if furniture of the manufacturer seldom or 
never sells -- but the primary net revenue derived by the 
5 promotion, procurement and image generation service stems from 

the placing and taking of orders for furniture, and to the lodging 
of these orders with the manufacturers (if the manufacturer is not 
an affiliate of the image generation service) for direct or 
indirect shipment to purchaser. The concept of maintaining 

10 profitable relationships with both customers -- who desire to buy 
prudently -- and with suppliers -- who desire to sell as much as 
possible -- may be compared to the profit model of the modern 

:3 supermarket chain where revenues are derived from both customers 

;f and suppliers (although the furnishings are orders of magnitude 

,§5 more expensive than food) . 

'J The present invention still further contemplates interactive 

;^ advertising. Name, the advertising consists of delivering to a 

y prospective customer of some customer-selected product a virtual 

:^ image of the product located within virtual scene, the virtual 

^gO scene permissively including still other virtual objects. In this 
U manner the prospective purchaser of almost anything may view the 

't^ object of his/her contemplated purchase in the environment of the 

;3 prospective purchaser's choice. 

3 . Detailed Description of the Present Invention 
25 Referring now to the drawings, FIG. 1 is a flow chart 

illustrating information flow within a preferred embodiment of the 
present invention. This preferred embodiment is described in 
reference to an interior decorating system on the Internet. Using 
a browser, this system permits professional interior designers to 
30 support many aspects of their business. These include identifying 
and selecting furnishings, creating realistic visualizations of 
furnished rooms, ordering swatches, preparing budgets, ordering 
furnishings, preparing invoices, tracking orders, staying abreast 
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of industry news, chatting with colleagues, and marketing their 
services . 

Designers will be able to rapidly identify and select 
furnishings, place them into a floor-plan view of a room model in 
5 the desired position along with decorative accessories, wall and 
floor coverings, and then rapidly render a screen image of the 
completed room scene, complete with lighting effects. It will 
also allow new furnishing objects, including furniture upholstered 
in selected fabrics, wallpaper and carpet to be superimposed with 
10 the proper perspective into photographically-derived model images 
of actual rooms. In this way, a realistic image can be created of 
an actual room that includes existing furnishings and 

□ architectural details, along with new furnishing objects selected 
by the designer. Such rendered images can then be e-mailed to 

;=;25 clients for approval, or large-scale high-resolution color prints 

can be ordered for use in client discussions. 
Q After selecting furniture objects for inclusion in a 

M particular room, they can be customized, by selecting from many 

1^ different fabrics and finishes, and by specifying various design 

j;-20 detail options. Such unique combinations may never have been 

built, but the system will nevertheless allow such customized 
Q products to be accurately visualized in actual room settings. 

□ As shown in FIG. 1, the process begins with determining 
membership status 101. In this representative embodiment, 

25 membership will only be granted to professional interior designers 
holding the proper credentials, after they request membership, 
provide the necessary information, and are accepted or rejected as 
members 102. Non-member "guests" will have access to only limited 
portions of the system 103, including a directory of local 

30 designers 104, and a public gallery of rendered images 105. 

From the Home Page 106, Members will contact customer service 
107, enter member preferences 108, enter the chat room 109, read 
industry news 110, and utilize the Project Manager 111 to create a 
new room scene 112, open an existing room scene 113, or order and 
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track purchases 114 and print project tracking reports 115. 

As shown in FIG. 2, one of three methods will be utilized for 
generating a 3D-room model to Create New Scene 201. Method 1 202 
involves uploading a 3D model of a room, or selecting such a model 
5 from a library of models, or generating such a model using an 

interactive floor plan layout tool. This tool will be designed to 
capture both floor plan, elevation and architectural detail 
information sufficient for the generation of a basic 3D room model 
of the desired size, shape and height. From here, the user can 
10 enter the Scene Builder 209 (described in the earlier reference to 
116) . Method 2 203 involves multiple digital photographic images 
of the same room, taken from different camera angles, and the 

□ actual distance between two points that appear in two images. 
Method 3 204 involves uploading a single digital photographic 

.M5 image of a room. Images uploaded under methods 2 and 3 will be 
processed by a human artist into working 3D models using one or 
more techniques that will allow the rendering of 3D objects into 

■'-4 the room scenes depicted by the digital photograph (s) . This model 

construction process requires the development and calibration of 

j;io models that have nearly perfect alignment with the designer- 

LH supplied photographic image or images. This will require creating 

not only the room model geometry, but also overlays for all walls, 

□ floors and ceilings visible in the room scenes. These will be 
carefully masked to allow textures like wall paper and carpeting 

25 to be accurately rendered on such surfaces without interfering 
with objects between the camera and the subject surfaces. Such 
objects, which must be masked, include plants, art work on walls, 
and existing furniture between the camera and a wall, floor or 
ceiling . 

30 In the case of Methods 2, the artist will use commercially 

available software tools to calculate the camera position that was 
used to take each picture. This will be accomplished in 
conjunction with creating the background scene models, by mapping 
like points across multiple images. 



In all three methods, other commercially available tools will 
be utilized to edit the models, create texture maps, and thereby 
prepare the models for use 206. A skeletal diagram will be 
created that illustrates each surface plane, allowing the designer 
to specify textures or colors for each individual plane 207. 
In method 2 and 3, the artist will also make a determination of 
the direction of natural light in the photos 208, for use in 
rendering the image . 

In the case of Method 3, the artist will use commercially- 
available software tools to build a model of the room 204 from the 
room image, and dimensions provided by the designer. 

Designers may be charged for the development of such room 
models 205, however, such cost may be refundable with the purchase 
of furnishings. Such human artist intervention will not be 
required if the designer chooses Method 1 for loading a room 
scene. However, Method 1 has its limitations - -namely the designer 
must build or have built a 3D model of the room, or he or she must 
select a room model from a library of room models, or use the 
floor plan tool to create one. In addition, such basic models may 
not fully reflect the design of the actual room being furnished. 
For example, such "stock" models may lack certain architectural 
details . 

Once these room models are ready for use by the professional 
designer, they will be filed on a server in the member's 
designated on-line file for later use 210, and the member will be 
notified that the model is ready for use 211. 

As shown in FIG. 1, once the Member is ready to begin laying 
out furnishings in the room, he or she will open a room scene 
model in the Scene Builder 116, and begin searching for images of 
appropriate furnishings, fabrics and textures, using the system's 
search tools 117. (Scene Builder is a product name of DecorMagic, 
Inc., San Diego, California.) The scene builder view 116 will 
contain a floor plan of the room to be furnished, search tools, 
and thumbnail images of selected furnishings and textures. 
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Clicking on such thumbnails will allow the designer to visualize 
the object in a larger size on the screen. Further clicking will 
allow zooming into any part of the image, using proprietary 
technology, to allow for closer inspection. 
5 Once individual furnishings have been selected for 

visualization in the room scene, clicking the desired thumbnail 
and then the floor plan in the desired location will automatically 
locate a properly scaled iconic representation of the furnishing 
into the room. Clicking on a selected texture and then on the 
10 furnishing icon to which it should be applied will allow the 

texture to be applied to the subject furnishing. This will allow 
such textures to be shown running the proper direction, and to 
O scale, on the designated furniture object and with the selected 

^ lighting effects once the room image is rendered. Any furniture 

-i5 icon may be rotated about its vertical axis to the desired angle 

by simply clicking on one of the dots that will appear like a halo 
□ around each icon. Room surface textures like wall paper and 

'"'-^ carpet, or wall paint color (collectively referred to herein as 

i'-^ textures) can be selected and applied in a similar manner, by 

(Mo clicking on the texture, and then on any wall, ceiling or floor 
LJ: area designated on a 3D perspective skeletal model of the room. 

Q Such skeletal model images will clearly designate individual wall, 

ceiling floor surfaces that are represented by overlay planes in 
the associated 3D room model. All such textures will be initially 
25 displayed on the associated icon, wall (in the case of wall paper) 
or floor (in the case of carpets) . Ceiling color or texture will 
be selected for use by clicking on a texture and then on the 
appropriate area of the 3D perspective skeletal model, but the 
ceiling will not be visible in the Scene Builder until the image 
30 is rendered, as the Scene Builder will not display the ceiling. 
Selected wall color or wall paper will be applied to each wall 
surface by first clicking on the texture and then clicking the 
desired wall segment in the skeletal model. 

Next, the designer will specify on the floor plan the 
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location of any windows that should be the source of lighting in 
the completed rendering. All such windows will be designated by 
clicking a window icon, specifying the dimensions, and then 
clicking the location of such window on the perimeter of floor 
5 plan, unless they are already part of a 3D model. 

Then, in the case of Method 1, the designer will select the 
desired camera position for rendering 118. This will be 
accomplished by clicking the camera icon, and then clicking the 
desired camera location on the floor plan. Camera height can be 
10 specified as well, by entering it in the appropriate screen field. 
However, if the room model was photographically-derived 
(constructed from two or more photographic images) , then the 
■'3 designer will specify which actual camera position to use for a 

^ particular rendering. Multiple renderings, from different actual 

==S5 or virtual camera positions can also be requested, included close- 
j'S up views of individual furniture groupings or areas of the full 

O image. Room lighting parameters can also be specified 119. The 

method of so specifying, which permits the rendered image to 
1=3 project similar lighting and shadows on the virtual objects, may 

^0 be, by way of example, that method more fully described in the 

proceedings from Siggraph 2000, Course 16, at page 354. The room 
□ scene is now complete and ready for rendering. By clicking the 

rendering button 120, this process is initiated. In this manner, 
an accurate and high-quality image of a professionally decorated 
25 existing or to-be-built room can be rendered to guide an iterative 
design process and to help a professional designer communicate 
design concepts to his or her client and for procurement. 

Finally, foreign objects (like images of art work) , may be 
imported 121/122; budgets and invoices may be prepared and printed 
30 123, and furnishings may be ordered 124. This system will also 
allow swatches 125 and high-resolution prints of the rendered 
images to be ordered in various sizes 126, and the rendered images 
to be posted to a public or private virtual gallery 127. In 
addition, it will be possible for rendered images to be saved in 



- 45 - 



user files 128, on the server, and e-mailed or otherwise 
transmitted 129 to third-parties on the network for review or 
approval . 

Normally, the rendering of complex 3D images can take hours 
5 (circa 2000) of computing time. The present invention 

contemplates dividing the rendered image into a number of sub- 
images before rendering begins, such that each sub- image can be 
rendered in parallel on a separate computer (massively parallel 
processing) . Once the individual sub- images have been rendered, 
10 they will be reassembled for presentation to the designer on his 
Internet browser. By this mechanism, or some other computing 
mechanism that achieves a similar result, the rendered image 
should be available for viewing very quickly-- possibly in less 
pfi than one minute. Changes can then be made in the location of 

=--l5 objects or the camera, the selection of finishes, etc., and the 
■p rendering process repeated until the designer is satisfied with 

i:3 the design. 

""'^ Fig. 3 illustrates some of the details associated with the 

rj process of selecting objects and textures 301. First, search 

|ifio parameters are specified in 302. Based upon these parameters, 

objects or textures that match the specified parameters are 
□ displayed as thumbnail images 303. The designer then selects one 

such thumbnail image, and the associated information page, which 
includes text as well as graphical information about the object or 
25 texture is displayed 304. The graphical information can then be 
inspected more closely by zooming into any area, repeatedly, to 
view greater and greater detail for smaller and smaller sections 
of the image 305. Then, in the case of textures, if the designer 
wishes to order a swatch of the selected material, he/she can do 
30 so by clicking a check-box, and add this material to the list of 
swatches to order 306. From 304, the designer can also elect to 
assign this texture to a specific object 307. 

Fig. 4 illustrates the method by which swatches can be 
ordered, once the desired materials are specified 401. The list 
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of fabrics assigned to specific objects can be displayed 402. 
This list can be replaced with a list 403 of all fabrics the 
designer has selected (in 306) . The designer can add to 404 or 
delete from 405 fabrics in this list. From either 402 or 403, the 
5 designer can place an order to have all the swatches on the list 
406 . 

FIG. 5 shows an example browser screen representing the Scene 
Builder, which continues on Fig. 6. The Furnishing Selector, 
Texture Selector, thumbnail images retrieved by these selectors, 
10 the floor plan into which iconic representations of furnishing 

objects are placed and rotated on their vertical axes, and various 
buttons to accomplish tasks are illustrated. 
□ The principals of the present invention should not be 

regarded as being limited solely to interior design. FIG. 7 
=£5 illustrates how it supports a novel form of interactive 
1=^ advertising. A prospective customer is able to place a properly 

Q scaled image of a luxury automobile into an image of his/her 

'^-1 driveway to examine it for contextual compatibility. The 

m prospective customer would be able to virtually customize the car, 

i^iO adding accessories like special wheels, or changing the color or 

-.H model, to see how the customized automobile would look against the 

ry ^ 

Q background scene of his or her residence. 

4 . Adaptations, Extensions, and Variations 

25 In accordance with the preceding explanation, variations and 

adaptations of the (1) interior decor composition and display, (2) 
advertising, and (3) fulfillment systems and methods of the 
present invention will suggest themselves to practitioners of the 
(1) digital computer imaging, (2) advertising, and (3) e-commerce 

30 arts. 

For example, the (1) composition and display could be of 
architect-designed additions to a residence. For example, the (2) 
advertising could be of resort apparel, illustrated on the 
prospective purchaser at the actual resort to be visited. For 
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example, (3) designers without showrooms, or even any such capital 
as would permit their creations to be fabricated in advance of 
purchase, could display their designs of expensive and/or 
extensive and/or physically large pieces in situ, thereby showing 
5 the products of their imaginations in virtual reality. 

In accordance with these and other possible variations and 
adaptations of the present invention, the scope of the invention 
should be determined in accordance only with the following claims, 
and not solely in accordance with that embodiment within which the 
10 invention has been taught. 



